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Abstract 

Lagrange multipliers constitute, via Lagrange’s theorem, an interesting approach to constrained optimization of 
scalar fields, presenting a vast range of applications. In this work, after briefly presenting Lagrange’s theorem and the 
concept of Lagrange multipliers, we discuss respective applications to several practical problems, including constrained 
maximization of area and volume, vibrating strings, electric circuits, as well as the classical cardboard box problem. 
Focus is kept on low dimensional problems, and extensive use of visualization is adopted as a means of contributing to 
the understanding of the involved problems and concepts. 


“Mais a la naissance du calcul differential, on n’avait pas 
encore une idee assez entendue de ce qu’on entend par 
fonction.” 

J. L. Lagrange. 

1 Introduction 

Optimization speaks for itself. It allows us to obtain, 
faster, less expensive, more robust, more energy efficient, 
solutions. Many researchers and students are familiar¬ 
ized with basic optimization concepts, such as find the 
extrema of functions. Indeed, as seen in calculus pro¬ 
grams, a function f{pc) will have an extreme value at x c 
provided ^f(x) =0, which corresponds to a critical point 
of f(x). Finding if such a critical point is a maximum 

or a minimum requires checking the value of its second 

,2 

derivative jppifix) at that point: if it is negative, we have 
a maximum, otherwise, we have a minimum. 

Many people have already used this important and 
practical result, and some may also be acquainted with 
finding extrema of scalar fields in higher dimensions, 
which involves obtaining the critical points - for which 
the gradient of the field is null, and then checking for 
maximum/minimum by applying the respective Hessian 
on those points (e.g. CD- 

However, relatively fewer readers will be probably be fa¬ 
miliar with the optimization approach known as Lagrange 
Multipliers (e.g. HE2II]). Yet, this approach is particu¬ 


larly interesting and practical, being inherently directed 
to optimizing a scalar field under some constraint, hence 
the name constrained optimization (e.g. nail]). Despite 
the many involved partial derivatives, the Lagrange mul¬ 
tipliers method in intrinsically simple, especially when ap¬ 
proached through a more graphic-oriented presentation. 
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Figure 1: Example of constrained optimization. A paraboloid is 
slice by a straight line defined on its ( x , y ) domain, and we are 
interested in finding the maximum along this line. Observe that this 
maximum, indicated with the star, exists but is different from the 
general maximum that would have been obtained by unconstrained 
optimization. 


In addition to providing insights for better understand- 
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ing the properties of scalar fields, the Lagrange multipliers 
method has immediate applications in a vast range of the¬ 
oretical and practical problems encompassing almost ev¬ 
ery area in the physical sciences. This method is founded 
on Lagrange’s Theorem, which states how to identify ex¬ 
trema of scalar fields subjected to algebraic constraints. 
For instance, one may be interested in maximizing the 
volume of some structure subjected to a fixed amount of 
material to be used (e.g. area, value, etc.). 

The present work is aimed at presenting, in a con¬ 
cise and introductory fashion, the constrained optimiza¬ 
tion method of Lagrange Multipliers. The organization of 
this work is straightforward. After presenting and briefly 
discussing Lagrange multipliers, we proceed with several 
application examples considering low dimensional spaces, 
extending from strings of musical instruments to circuit 
analysis, also including classical examples such as design¬ 
ing, under the restriction of fixed available material, of 
a box that maximizes volume. The presentation will of¬ 
ten resource to visualizations as a means of better under¬ 
standing the problems and respective solutions. 

As the other above mentioned optimization methods, 
the Lagrange theorem only identifies critical points of the 
constrained formulation, not indicating the nature of the 
respective critical points, if they are maximum, minimum 
or other types of points. Though the identification of 
those points can be approached by using the bordered Hes¬ 
sian (e.g. 0 ) of the respective constrained optimization 
problem, this can be relatively intricate at times. 

Instead, it is often possible check the type of extreme 
by considering the scalar field under the restriction (e.g. a 
paraboloid in !ft 2 sliced by restrictions becomes a function 
of one variable), visualizing the respective field, or by ob¬ 
serving the own nature of the respective problem. 

This is helped by the fact that, in the present work, 
we are mostly restricted to Lagrange multipliers with do¬ 
mains on !ft 2 or !ft 3 . For instance, in 5ft 2 it is possible to 
visualize the level sets of the scalar field to be optimized 
jointly with the imposed restriction, as well as to iden¬ 
tify possible critical points defining by alignments of the 
respective gradients. 

2 Lagrange’s Theorem 

Let ip(x) be a differentiable scalar field on Sft^, such as: 

N 

fj(x) = — ^^X? + C (1) 

i= 1 

In case N = 2, and using x and y instead of x\ and X 2 
for simplicity’s sake, we can write as a possible example: 

ip(x,y) = -x 2 -y 2 +c. (2) 


Observe that xjj(x,y) can be understood as a surface 
(x,y,'i/j(x,y)) G !ft 3 with respective domain (x,y) G 5ft 2 . 

We have already commented on how it is possible to 
consider the gradient and Hessian of these fields in or¬ 
der to identify and characterize eventual extrema values. 
However, we may also be interested to seek for extrema 
under constraints. For instance, we could be interested 
in finding the maximum of the scalar field given in Equa¬ 
tion [lj for c = 2, while its domain is restricted to the line 
y = x — 1, as shown in Figure [9] 

In the case of a general scalar field on 5ft^, it defines 
a hypersurface in 5ft Ar+1 , and constraints gi{x) = Ci, i = 
1,2,..., M, can be considered, with M < N . In other 
words, the constrains act on a space that is one dimension 
less than the dimension occupied by the field. In the case 
of a scalar field embedded in 5ft 3 , the constraints will be 
curves along 5ft 2 . 

Though the scalar field in Figure [9] reaches its overall 
maximum for xm = (0, 0), when it is considered along the 
restricting line, it will achieve its maximum at another 
point Xm = ( X m ,ym )• 

One way to find x m would be to substitute the con¬ 
strain y = x — 1 into 'ip(x^y), yielding the function 
g(x) = — x 2 — {x — l) 2 + c, and then use the stan¬ 
dard approach in calculus, i.e. find x m as the solution of 
x 2 — (x — l) 2 + c) = 0, and then make y rn = x rn — 1. 

Lagrange’s Theorem provides an alternative means for 
finding the extrema of scalar fields subjected to addi¬ 
tional constraints of the type gi{x) = Ci , i = 1, 2,..., M, 
where ci are specific constants. Observe that, as such, 
Lagrange’s Theorem only identifies critical points of the 
constrained optimization, but does not tell us wether each 
of those points is a maximum or a minimum. 

Minimization can be immediately addressed by chang¬ 
ing the sign of the scalar field. 

Let A i, i = 1,2, ...,M be the Lagrange multipliers , 
which, when understood to be fixed, define the following 
new scalar field g{x) on 5ft Ar : 

g(x,X) = 

= Ai [gi(x) - Cl] + A 2 \g 2 (x) -c 2 ] + ...+ Am [5m (x) - c M ] 

The Lagrangian function of the constrained maximiza¬ 
tion of 'ip(x) can now be expressed as: 

C |f, A | = ip(x) + g(x, A) (3) 

where A = (Ai, A 2 ,..., Am)- 

For instance, if fj(x,y,z) = — x 2 — y 2 + 2 subjected to 
y — x = —1, we have: 

C {f, a} = 

= ip(x) + g(x, A) = -x 2 - y 2 + 2 + A (y - x + 1) 
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Lagrange’s theorem states that the sought maximum 
can be found by solving, if possible, the following system 
of equations: 


^£UA|=0 

^k4=o 


= 0 


af4=° 

^£{f,A} = 0 


d\ 


|f, a| 


= o 


wit M < N. 

Observe that the above can be rewritten more com¬ 
pactly as: 


VC jx, A | = Vtjj(x) + Vg(x, A) = 0 


( 4 ) 


It can be immediately verified that the previous system 
of equations can be rewritten in the following alternative 
form: 




dx 2 £ 1 ^ f — ® 


8 r 

3xn 


{s.a} 


= 0 


gi(x) = ci 
g 2 (x) = c 2 

9m(x) = cm 

In the case of the considered example, we have: 

^ (~x 2 - y 2 + 2 + \[y - x}) =0 
A. ( 

dy V 


-X 


2 - y 2 + 2 + X[y - x]) = 0 
y-x = -1 


( 5 ) 


implying: 



(6) 


We make: 

—2x — A = 0 = 
—2 y + A = 0 


A = —2x 
> X = 2y 


=^> —2x = 2 y ^ x = —y 


substituting into the constrain, we have that y = — i, 


so that x 


4 and A = 


- 1 . 


Vm — 2 

A = -1 


( 7 ) 


3 A Conceptual Discussion 

The basis of Lagrange’s theorem is the solution of the 
equation: 

V^(x) + Vg(x, A) = 0 ^ V^{x) = —Vg(x, A) (8) 

We have two scalar fields on 5ft ^ namely and 

g(x, A), and we aim at finding instances of A, as well as 
critical points (x c , ?/ c ) so that the respective gradients be¬ 
come identically opposed. 

Let’s discuss this interesting principle with respect to 
the simple example of the paraboloid ip{x,y) = — x 2 — 
y 2 + 2 constrained by the straight line g(x,y) = y — x + 1 
(see Figure [9]). 

While the scalar field can be readily understood, it is 
the constraint g(x,y) = y — x + 1 that requires more 
attention. In order to do so, let’s consider the respective 
Lagrangian: 

C {x, y , A} = -x 2 - y 2 + 2 + A (y - x + 1) 

Observe that the constraint enters the Laplacian as the 
scalar field w(x, y , A) = A (y — x + 1) which, for a fixes A 
effectively corresponds to a plan in 5ft 3 with domain on 
5ft 2 . 

As A varies, with A G S), a family of plans is defined, 
all of which crosses the (x, y) domain along the straight 
line gi(x,y) = y — x = —1. The parameter A effectively 
controls the inclination of this plan with respect to the 
(x,y) domain. 

In this specific case, the solution involves finding the A 
that yields the gradient of the plan w(x, y , A) = \(y—x+l) 
at point (x c ,y c ) identical to the inverse of that of i/;(x,y) 
at this same point, i.e. V^{x) = —Vg(x, A) at (x c ,y c ). 


4 Maximizing the Area of a Rect¬ 
angle 

Let’s now consider the situation in which we build rect¬ 
angles of sides x and y with fixed perimeter P, yielding 
the restriction: 


9 i(x,y) = 2x + 2y = P (9) 

Now, we wand to identify x and y so that the area of 
the rectangle A(x,y) = xy is maximum. 

We start by writing the respective Lagrangian function: 

£{x,y, A} = xy T \[2x + 2y - P\. (10) 

which leads to: 

f ^{xy + X[2x + 2y-P}) = 0 
\ ^ (xy + X[2x + 2y - P]) = 0 
[ 2x + 2y = P 
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(a) (b) 

Figure 2: Illustration of the concept behind Lagrange’s theorem. Given the scalar field i/j(x, y ) (a, in blue) and the constraining plan 
w(x,y. A) (in orange), a A is sough so that 'V'ijj(x) (blue arrow) equals — S/g(x, A) (red arrow) at ( x c ,y c ) (show in cyan). Observe that the 
position of the plan is immaterial, so that the intersection between the two scalar fields is also not important. What matter are the gradients, 
defined in the plan ( x,y ), as illustrated in (b). 


By developing the partial derivatives, we get: 


y + 2A — 0 
x + 2A = 0 
2x + 2y = P 


and we find that: 

a = “ 2 ; X = ~2^ x = y 

then: 

P 

2x + 2y = 2x + 2x = c\ =+ x = y = — 
implying A = and A = — |. 

Figure [3] illustrates this constrained optimization prob¬ 
lem in terms of the scalar field and respective level sets. 
Though this scalar field has a global saddle point at (0, 0), 
the imposed constrain implied in the definition of the crit¬ 
ical point (P/4, P/4) as being a maximum of the con¬ 
strained optimization. 

We can reach the same conclusion by considering the 
function defined by constraining the surface !px, y con¬ 
strained by the straight liner y = x — 1, i.e.: 


f(x) = - x 2 - (x - l) 2 + 2 = -2x 2 + 2x + 1 (11) 


We have that J^/(x) = —4x + 2 = 0 implies that x c = 
1/2, and that = —4, implying that the critical point 
is a maximum. 


H c 


A 

dx 2 


/(*) = 2 


Therefore, we have that the constant perimeter rectan¬ 
gle that maximizes the area corresponds to the square. 

5 Plan Constrained by a Circle 

Let’s now find the maximum of the plan -0( x , y) = — x — y 
subjected to gi(x,y) = x 2 + y 2 = 1. Observe that g\ 
corresponds to a circle of radius 1 centered at the origin 
of 5ft 2 . 

We have that: 


9i(x,y) = x 2 + y 2 = 1 (12) 

so that the Lagrangian respective to this problem is: 


£ {^(x, y),g(x, y)}) = -x-y + X(x 2 + y 2 - 1). (13) 

Thus, we have the system: 


f I? i~ x - y + W 2 + y 2 )) = 0 

{ ^(-x-y + Hx 2 + y 2 )) =o (14) 

( x 2 + y 2 = 1 

which yields: 


— 1 + 2x\ = 0 
-1 +2y\ = 0 
x 2 + y 2 = 1 
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(15) 















X 

(a) (b) 

Figure 3: The scalar field i/j(x,y) = xy (a) , corresponding to the area of the sought rectangle is to be optimized under the restriction of 
keeping its perimeter constante, i.e. 2x + 2y = P. The straight line restriction is shown in green in (b), and the orange dot identifies the 
found critical point, which turns out to be a maximum of p(x,y). 


whose respective solutions are: 


1 — + ^ 
Urn, 1 = 

%m, 2 ^ 2 “ 

- 

2 


(16) 


Vm, 2 — 


\ _ a/2 

A — 2 


Figure [4] illustrates this restricted optimization prob¬ 
lem. 


6 Maximizing the Volume under a 
Surface 


The Lagrange theorem can also be applied on scalar fields 
derived from scalar fields. Consider the situation depicted 
in Figure [5] 

We start by obtaining the equation of ^(a, b ) as: 


/ a no 

/ (xy)dxdy 

= £(H -/>> 


-b 


= I - r v 


dx = 


2 r 2 


= arb 


(17) 


The imposed constrain can be expressed as: 


which yields the Lagrangian, 


£, 6), cjicL-, fr) }) — o? T 6 2 T A[2u T 2 b — P \. (19) 

Now, we have to solve the respective system of equa¬ 
tions: 

( £ (a 2 + b 2 + A[2a + 2b - P]) = 0 
I 55 iP ' (•>” ' A[2a + 2 b — ) = 0 (20) 

{ 2a + 2b = P 

By calculating the partial derivatives, we find that: 


{ 2u T 2A — 0 
26 + 2A = 0 
2a + 2b = P 

from which: 


a = b = 


P 

J’ 


V = a 4 


p4 

256 


( 21 ) 


( 22 ) 


7 Vibrating String 

Now, we consider a physical problem, involving a vibrat¬ 
ing string, whose frequency can be approximated as (as¬ 
suming linear wave equation): 


/ = /(L,2» 



gi(a , b) = 2a + 2b = P 


(18) 
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(23) 
















X 

Figure 4: The scalar field ^){x,y) = —x — y is to be optimized 
subjected to the constrain x 2 + y 2 = 1, which corresponds to a 
circle in the domain (x,y). Two critical points, shown in orange, 
are found. One of them corresponds to a minimum (blue), and the 
other, to a maximum (red). 



Figure 5: Given a rectangle R defined in the domain (x,y) as —a < 
x < a and —6e < y < 6, we are interested in finding its sides 2 a and 
26, with perimeter P = 2a+ 26 kept constant, so that the volume of 
the scalar field £(#, y) = xy is maximized. Observe that this sought 
volume corresponds to another scalar field ^(a^b) which is to be 
considered in the constrained optimization. 


where / is the vibration frequency (in Hz), L is the 
length of the string (in m), T is the string tension (in N ), 
and fi is the mass density of the string (in kg/m 3 ). 

In order to make the problem a little bit more com¬ 
plete, we assume that brass as the string material (/i^ r ~ 
8500 kg/m 3 ), and that the string has radius r, so that an 
effective mass density can be expressed as: 


a distortion on the relationship among the partials (har¬ 
monics) in the obtained sound. So, we may wan to reduce 
T while having r not to depart too much from a reference 
radius r t . Under these circumstances, we may write the 
following scalar field to be minimized: 

ip(T,r) = a{niM,(r - rtf) + PT 2 (27) 


M (24) 

Hence, we have: 


f = f(L,T,r) = H 


(25) 


2 Lr y it/ibr 

For simplicity’s sake, we adopt the abbreviation v = 


7T \lbv 

If we aim the string to have a fixed frequency / = 30 Hz, 
the above equation yields a respective constraint: 


where a and (3 are weights associated to the respective 
effects of T and r. We assume a = 20 and /3 = 0.00001. 

Observe that this is only a didactic example, in the 
sense that a real situation would probably consider differ¬ 
ent forms of ip and weightings. 

Also, we will consider that T G [10,300] and r G 
[0.0005, 0.002] m, and we take the reference radius as being 
the averages of the extrema of the latter interval, i.e. r t = 

T* max TC m in 

2 

The Lagrangian of the above hypothetical problem 
therefore can be written as: 


9 i{T,r) = t 3-\—~ = f ( 26 ) 

2 Lr y 7 T/J, br 

We will considered that the length of the string is pre¬ 
determined as L — 1 m. 

Now, the tension T on the string, as well as its radius r 
influence the quality of the solution, as the tension implies 
in sturdier frame for holding the string, and the radius r 
can have great impact on the quality of the sound pro¬ 
duced by a real string. In principle, thick strings imply 


£WP»,«P»}- 

(28) 


As this systems is hard to be solved, we will be re¬ 
stricted to its graphical representation, shown in Figure[6] 
We find the optimal solution to be r « 0.00095m = 
0.95mm and T ~ 857V. 
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Figure 6: Graphical representation of the vibrating string prob¬ 
lem with cost to be minimized given by the scalar field ^(T, r) = 
a ( 717 x 5 ( 7 * — rt ) 2 ) + (3T 2 . The constrain gi(T,r) = 30 Hz is also 
shown as the green curve. The solution is shown as the cyan point, 
yielding r m « 0.00095m = 0.95mm and T m « 85 N. 


Also, by Kirchhoff’s current law, we have: 


I = h + h m h + -h « 
s 


( 1 + ;) 7 ‘ 


h = 


r + 8 


which yields: 


h 


(31) 


Now, the total power dissipated by both loads can be 
expressed as: 


P(r, s ) = rl\ + si 2 = 

=r f^_y + .f^_y = 

\r + sj \r + sj 

r(sl ) 2 s(rl) 2 
(r + s) 2 + (r + s) 2 
r(s/) 2 + s(rl) 2 _ r(sl) 2 + s(rl) 2 


(r + s) 2 i? 2 


From which we obtain the scalar field to be maximized: 


^(r, s ) = r(sl ) 2 + s(rl) 2 = rs 2 / 2 + 8r 2 / 2 
The respective Lagrangian can now be written as: 


8 Electric Circuit 

Let’s now consider a constrained optimization problem 
involving the dissipation of power in ideal resistors, in 
ideal electric circuits. More specifically, Figure [7] shows a 
simple circuit involving an ideal current source connected 
to two ideal resistive loads r and s so that r + s = R. 
Under the restriction that the supplied current is fixed 
as /, we try to find which values of r and s would imply 
maximum energy dissipation in the two loads. 


/ 

—► 



Figure 7: The electric circuit considered in the constrained opti¬ 
mization example. 


The adopted restriction immediately leads to: 


s),g(r, s)}) = rs 2 1 2 + sr 2 1 2 + A (r + s — R). 

so that: 

( ( rs 2 1 2 + sr 2 ! 2 + A(r + 8 - R)) = 0 

< ^ (r8 2 / 2 + 8r 2 / 2 + A(r + 8 — R)) = 0 
[ r + 8 = R 

The above system implies that: 

8 2 / 2 + 2 srl 2 + A = 0 
2 rsl 2 + r 2 / 2 + A = 0 
r + 8 = R 

So that we conclude that: 

8 2 / 2 + 2srl 2 = 2rsl 2 + r 2 / 2 ^ 

=^> 8 2 + 2sr = 2rs + r 2 r = 8 

The obtained result indicates that maximum dissipa¬ 
tion would be observed when the resistance of both loads 
are identical. Figure [8] illustrates the level sets, and con¬ 
straints curve respective to the constrained optimization 
problem studied in this section, assuming R = 1000U and 
I = 10/iA 


9 i(r,s) = r + 8 = R (29) 

Let’s derive the circuit equations. As the voltage is the 
same for both loads, we can write: 


9 Carboard Box 


V r = V a => rh = al 2 =>I 2 = -h 

8 


(30) 
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Let’s now consider the classical interesting practical prob¬ 
lem of making a carboard box with volume V while min¬ 
imizing the cardboard cost (i.e. minimal area A). 







































1000 



r 


(a) (b) 

Figure 8: (a) The power dissipation curve and (b) the level sets including the constraint (green line) respective to the considered electric 
circuit dissipation problem, assuming R = 100017 and / = 10 /lA. 



Figure 9: The geometry of the addressed cardboard box optimiza¬ 
tion. 


The box is assumed to have sides x, y, and z, so that the 
respective volume is V = xyz , and total area A(x,y,z) = 
3 xy + 2yz + 2 xz, as we want to have double cardboard in 
the bottom for strenghtening. 

Thus, we aim at maximizing the scalar field i/j(x,y,z) = 
—A = —3 xy — 2 yz — 2 xz subjected to the constraint 
9 i(x,y,z) = xyz = A. 

We have: 


9 i(x,y,z) = xyz = A (32) 

and Lagrangian: 


C{ip(x,y,z),g(x,y,z)} = -3xy-2yz-2xz + X(xyz - A). 

(33) 


(“3 xy - 2yz - 2xz + A (xyz - A)) = 0 
^ (-3 xy - 2 yz - 2 xz + A (xyz - A)) = 0 
(—3 xy — 2yz — 2xz + X(xyz — A)) = 0 
xyz = V 


(34) 


—3 y — 2z + X(yz) = 0 
— 3x — 2z + A (xz) - 0 
—3 y — 2x + A (xy) = 0 
, xyz = V 

First, we make: 


(35) 


A = 


3 y + 2z 2x + 2z 2x + 2 y 


yz 


2 

y 


xz 

2 


2 

—I— — 
z x 

3 _ 2 _ 
z x 
2 _ 2 

* y 


xy 

2 2 


* ~ 2 ^ 
x = y 


We also have that: 


T . 3 3 / 2V A 1/3 

xyz = V => —x => x = I — I 

from which we get the solution: 

(2v y/ 3 


fc=(^) i,s 

y _3 /2F\V 3 
~ 2 V 3 ) 


The system for this optimization is: 



















Therefore: 


A — 3 xy + 2 yz + 2 xz - 



Observe that if all sides were simple, we would have all 
the three sides identical, meaning that a cubic box with 
single sides optimizes the volume. 

10 Concluding Remarks 

Optimization is an fundamental and interesting problem 
on itself, also leading to a variety of practical applications. 
The mathematical result known as Lagrange’s theorem 
provides an important resource regarding constrained op¬ 
timization problems. 

In the present work, we developed a practical approach 
to Lagrange multipliers in a concise and hopefully didactic 
manner in which, after presenting and briefly illustrating 
Laplace theorem, we discussed its principle in a concep¬ 
tual and graphical manner. Then, a sequence of examples 
was presented, including maximizing area and volume, de¬ 
signing a vibrating string, studying maximum dissipation 
in electrical circuits, as well as the classical design of an 
optimal cardboard box. 

It is hoped that this work can motivate the reader to 
probe further into the alluring area of mathematical op¬ 
timization. 
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Costa’s Didactic Texts - CDTs 


CDTs intend to be a halfway point between a 
formal scientific article and a dissemination text 
in the sense that they: (i) explain and illustrate 
concepts in a more informal, graphical and acces¬ 
sible way than the typical scientific article; and 
(ii) provide more in-depth mathematical develop¬ 
ments than a more traditional dissemination work. 

It is hoped that CDTs can also incorporate new 
insights and analogies concerning the reported 
concepts and methods. We hope these character¬ 
istics will contribute to making CDTs interesting 
both to beginners as well as to more senior 
researchers. 

Each CDT focuses on a limited set of interrelated 
concepts. Though attempting to be relatively 
self-contained, CDTs also aim at being relatively 
short. Links to related material are provided in 
order to complement the covered subjects. 

Observe that CDTs, which come with absolutely 
no warranty, are non distributable and for non¬ 
commercial use only. 

The complete set of CDTs can be found 
at: https://www.researchgate.net/proj ect/ 
Costas-Didactic-Texts-CDTs, 
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